Concepedia

Concept

dynamic programming

Parents

Children

7.4K

Publications

428.6K

Citations

14.9K

Authors

3.1K

Institutions

Differential Dynamic Programming

1968 - 1976

The period foregrounded differential and decomposed dynamic programming for high-dimensional and continuous-state problems, with block decomposition and embedded state-space reductions dramatically extending memory efficiency and problem size. Dynamic programming was applied to capital budgeting, inventory planning, and production scheduling, linking sequential decisions to horizon planning and capital expenditure sequencing across domains. Extensions to differential/continuous dynamic programming and nonstandard objective structures enriched continuous-time decision problems and provided robust, convergent policy computation.

Dimensionality reduction and memory efficiency emerged as core themes in DP, with decomposition into blocks, embedded state-space reductions, and resource-focused analyses enabling larger problems, particularly in water resources and high‑dimensional settings [4], [11], [17], [13].

Dynamic programming was applied to capital budgeting, inventory planning, and production scheduling, linking DP to budget constraints, horizon planning, and capital expenditure sequencing across diverse domains [2], [9], [18], [15], [3].

Differential/continuous DP and optimal control innovations extended DP to continuous-time decision problems, introducing differential DP and higher‑order algorithms for robust, convergent policy computation [7], [16], [6].

State-space analytic formulations and nonstandard objective structures (reward operators, preferences, linear decision rules) broaden DP beyond classic value iteration, enabling analytic/reward-based updates and rule-based decision models [19], [20], [10], [14].

Decomposable Dynamic Programming

1977 - 1983

Uncertainty-Aware Structured Dynamic Programming

1984 - 1990

Near-Linear Time Dynamic Programming

1991 - 1997

ALP-Based Dynamic Programming Framework

1998 - 2004

Adaptive Approximate Dynamic Programming

2005 - 2011

Convergent Adaptive Dynamic Programming

2012 - 2018

Robust Adaptive Dynamic Programming

2019 - 2023